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People respond to the hazards they perceive. If their perceptions 
are faulty, efforts at personal, public and environmental protection 
are likely to be misdirected. For some hazards, such as motor vehicle 
accidents, extensive statistical data are readily available. For other 
familiar activities, such as the consumption of alcohol and tobacco, # 
assessment of risk requires complex epidemiological and experimental studies. 
- However, even when statistical data are plentiful, the "hard" facts 
can only go so far towards developing policy. At some point, human 
judgment ,is jigeded to interpret the findings and determine their relevance. 
Still other hazards, such as those associated with recombinant DNA 
research or nuclear power, are so new that risk assessment must be based 
on complex theoretical analyses such as fault trees (see Figure 1), rather 
than on direct experience. Despite an appearance of objectivity, these 
analyses, too, include a large domponent of judgment. Someone, relying 
on educated intuition, must determine the structure of the problem, the 
consequences to be considered, and the fportande of the various branches 


of the fault tree. Once the analyses have been performed, they must be 
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coumundedeed to those who actually manage hazards, including industrialists, 
epeaa atone. regulators, legislators, and voters. If these 
people do not understand or believe the data they are shown, then distrust, 


conflict and ineffective hazard management are likely. 
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This paper explores some psychological elements of the risk- 
assessment process. Its basic premises are that both the public and 
the experts are necessary participants in that process, that assessment : 
is inherently subjective, and that understanding judgmental limitations 
is crucial to effective decision making. 

JUDGMENTAL BIASES IN RISK PERCEPTION 

When lay people are asked to evaluate risks, they seldom have 
Statistical evidence on hand. In most cases, they must make inferences 
based .on what they remember hearing or observing about the risk in 
question. Psychological research, much of which has been described 
earlier in this book, has identified a number of very general inferential 
rules that people seem to use in such situations. These judgmental rules, 
known as heuristics, are employed to reduce difficult mental tasks to 
simpler ones. Although they are valid in some circumstances, in others 


i 
they lead to large and persistent biases with serious implications. 


Availability 
One heuristic that has special relevance for risk perception is 
called availability (Tversky & Kahneman;:- 1973; Chapter ). People using this 
heuristic judge an event as likely or frequent: if instances of it are 
easy to imagine or recall. Because frequently occurring events are 
generally easier to imagine and recall than are rare events, availability 
is often an appropriate cue. However, availability is also affected by 


numerous factors unrelated to frequency of occurrence. For example, a 
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recent disaster or a vivid film such as "Jaws" or "The China Syndrome" 

could seriously distort risk judgments. 

Availability bias helps explain people's misperceptions and faulty 
decisions with regard to certain natural havstae: For example, in 
discussing flood plain residents, Kates (1962) wrote: 

. A major limitation to human ability to use improved flood 

hazard information is a basic reliance on experience. Men on 

‘flood plains appear ibe very much prisoners of their exper- 

jence ... . Recently experienced floods appear to set an 

upward bound to the oe of loss with which managers: belhievesthey~ 

ought to be concerned (p. 140). 

Kates attributed much of the difficulty in improving flood control 
to the “inability of individuals to conceptualize floods that have never 
occurred" (Kates, 1962; p. 92). He observed that individuals forecasting 
flood potential "are strongly conditioned by their immediate past and 
limit their setianpiieaew vo simplified constructs, seeing the future as 
a mirror of that past" (p. 88). Stiiaeiy, the purchasewnf earthquake 
insurance increases sharply after a quake, and then decreases steadily 
as memories fade (Steinbrugge et al., 1969). 

One particularly important implication of the availability heur- 
istic is that discussion of a low-probability hazard may increase its 
memorability and imaginability and nee its perceived riskiness, regard- 
less of what the evidence indicates. For example, leaders in the field 
of recombinant DNA research quickly regretted. ever bringing to public 
attention the remote risks of contamination by newly created organisms. 
Rosenberg (1978) summarized the reaction that followed the revelation 


of such hypothetical risks: 


Initially, the response was one of éreitise for the... 
social responsibility shown by the scientists involved... . 
Gradually and predictably, however, the debate became nested: 
Speculation abounded arid the scarier the scenario, the wider 


the publicity it received. Many of the discussions of the 


desue-omplereiy lost sight of the fact that the dangers were 
hypothetical in the first place and assumed that recombinant 
DNA laboratories were full of raging beasts. Ultimately, the. 
very scientists whose self-restraint had set the whole process 


in motion were vilified (p. 29). 


Fee Judged frequeficy of lethal events. Availability bias is illustrated | 
by nigel studies in which college students and members of the League 

of Women Voters judged the frequency of 41 causes of death (ld chtenstein, 
Slovic, Fischhoff,‘:Layman & Combs, 1978). In one study, these people 
were first told the annual death toll for one cause (motor vehicle 
accidents) in the United States (50,000) and then asked to estimate the 
frequency of the other 40. In another study, participants were asked 

to judge which of two causes of death was more frequent (i.e., "How 
eee more frequent is it?" In both studies, judgments were mod- 
erately accurate in a global sense: people usually knew which were the 


most and least frequently lethal events. Within this global picture, 


however, people made serious misjudgments, many of which seemed to 
reflect the influence of availability. 

Figure 2 compares the judged number of deaths per year with the 
number reported in public health statistics. If the frequency judgments 
were accurate, they would equal the statistical rates, with all data 


points failing on the identity line. Although more likely hazards 
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generally evoked higher estimates, the points seem scattered about a 
curved line that lies sometimes above and sometimes below the line of 
accurate judgment. In general, rare causes of death were overestimated 


and common causes of death were underestimated. 


In addition to this general bias, sizable specific biases are 
evident. For example, accidents were judged to cause as many deaths 
as diseases, whereas diseases actually take about 15 times as many 
lives. Homicides were incorrectly judged more frequent than diabetes 
and stomach cancer deaths. Homicides were also judged to be about as 
frequent as death by stroke, although the latter: actually claims: about 
11 ‘times as many lives. Frequencies of death from botulism, tornadoes, 
and pregnancy (including childbirth and abortion) gene alte greatly over- 
estimated. Table 1 lists the lethal events whose frequencies were most 
poorly judged in our various studies. In keeping with availability 
considerations, overestimated ecauses of death were dramatic and sensational, 
whereas underestimated causes tended .to be unspectacular events, 


which claim one victim at a-time and are common in nonfatal form. 


Biased newspaper coverage and biased judgments. The availability 


heuristic highlights the vital role of experience as a determinant of 
perceived risk. . If one's experiences are biased, one's perceptions are 
likely £6 be inaccurate. Unfortunately, much of the information to which 
people ere provides a distorted picture of the world of hazards. 
Consider author Richard Bach's observation about the fear shown by a 
couple taking their first eveslaue rides 

In all that wind and engineblast and earth eins and 


going small below us, I watched my Wisconsin lad and his girl, 
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to see them enangele Despite their laughter, they had been afraid 

of the eae Their only knowledge of flight came from 

newspaper headlines, a knowledge of collisions and crashes 

and fatalities. They had never read a single report of a little 

airplane taking off, flying through the air and landing again 

safely. They could only believe that this must be possible, 

in spite of all the newspapers, and on that belief they staked 

their three dollars and their lives (Bach, 1973, p. 37). 

As a follow-up. to the studies reported above; Combs and Slovic 
(1979) examined the reporting of causes of death in two:newspapers on 
oppasite coasts of the United States. Various indices of newspaper 
coverage were recorded for alternate months over a period of one year. 
The results indicated that both newspapers: had similar biases in their 
coverage of life-threatening events. For example, examination of Table 2 
indicates that many of.the statistically frequent causes of death Ca en 
diabetes, emphysema, caetods forms of cancer) were rarely reported by 


either paper during the period under study. In addition, 


violent, often catastrophic, events such as tornadoes, fires, drownings, 
homicides, motor vehicle accidents, and all accidents were reported much 
more frequently than less dramatic causes of death having similar (or 
even greater) statistical frequencies. For dseaiieey diseases take about 
16 times as many lives as saccidents, but there were more. than three = 
times as many articles about accidents, noting Simost seven times.:as many 
deaths. Among the more frequent events, homicides were the most heavily 
reported category in proportion to actual frequency. Although diseases 
claim almost 100 paws as many livésias do homicides, there were about 


three times as many articles about homicides as about disease deaths. 


Furthermore, homicide articles tended to be more than twice as long 
as articles reporting disease and accident deaths. 

Moreover, the biases in newspaper coverage and people's judgments 
were quite similar. The correlation between judged frequency of death 
and the number of deaths reported in the newspapers was about .70. This 
high correlation was not due to a common association of both judged and 
reported deaths with statistical frequency. When the latter ao held 
constant, the partial correlations between peapiere judgments and the 
number of deaths reported were .89 and .85 for the two newspapers. 

Although it is papi tue to conclude from these correlations that media 
coverage biases perceptions of risk, it might also be the case that. 
people's opinions about what is important influence the media. The 
journalism literature is replete with instances in which influenceshas 
occurred in each direction (Brucker, 1973). 

It_won't happen to me. People's judgments of causes of death may be 
about as good as could be expected, given that they are neither specialists 
in the hazards considered nor exposed to a representative sample of 
information. Accurate perception of misleading samples of information 
might also be seen to underlie another apparent judgmental bias, people's 
predilection to view themselves as personally immune to hazards. The 
great majority of individuals believe themselves to be better than average 
drivers (Nadtdnen & Summala, 1975; Svenson, 1979), more likely than average 
to live past 80 (Weinstein, 1979), less likely than average to be harmed 
by products they use (Rethans, 1979), and a0 on, Although such perceptions 
are obviously unrealistic, the risks look very small from the perspective 
of each individual's experience. Consider qutonabile deivine: despite 


driving too fast, tailgating, etc., poor drivers make trip after trip 


without mishap. This personal experience demonstrates to them their 
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exceptional skill and safety. Moreover, their indirect experience via 
the news media shows them that when accidents happen, they happen to others. 
Given such misleading experiences, people may feel quite justified in 
refusing to cake proteus actions such as wearing seat belts (Slovic, 
Fischhoff & Lichtenstein, 1978). 

Out of sight, out of mind. In some situations, eae to appreciate 
the limits of "available" data may lull people into complacency. Ina 
study by Fischhoff, Slovic and Lichtenstein (1978), three groups of college 
student subjects were asked to evaluate the completeness ges fault tree 
showing the risks associated with starting a car (see Figure 3). One group 
saw the full tree. Each of the other two groups received a different pruned 
tree. In one version, the starting, ignition and mischief branches were 


missing; the other lacked branches detailing battery, fuél and other engine 


problems. 
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Instructions for the task read as follows (numbers in brackets were 
given to people who saw the pruned trees): 
Every day, across the United States, millions of drivers perform 
the act of getting into an automobile, inserting a key in the 
ignition switch, and attempting to start the engine. Sometimes the 
engine fails to start, and the trip is delayed. We'd like you to think 
about the various problems that might be serious enough to cause a car 
to fail to start so that the driver's trip is delayed for at least 1 minute. 
The chart on the next page is intended to help you think about 
this problem. It shows six [three] major deficiencies that 
cause a car's engine to fail to start. These major categories 


probably don't cover all possibilities, so we've included 


a seventh [fourth] category, All Other Problems. 
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Please examine this diagram carefully and answer the follow- 
ing question: 

For every 100 times that a trip is delayed due to "starting 


failure," 


estimate, on the average, how many of those delays are 
caused by each of the seven [four] factors. Make your estimates 
on the blank lines next to the factors named below. Your esti- 
mates should sum to 100. 
If people who saw the pruned trees were properly sensitive to 
what had beensomitted, the proportion of problems that they attributed 
to “other' would have equaled the sum of the proportions of problems 
attributed to the pruned buanches and to "other" by those who saw the 
full tree. The results in Table 3 indicate that what was out of sight 
was effectively ae of mind. For example, pruned tree Group ic ene 


should have increased by a factor of six (from .078 to .468) to reflect 


ae eg 
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the proportion of failures due to starting. and ignition problems:. 

and mischief, which had been. omitted from the diagram. Instead, 

"other" was only doubled, whereas the importance of the. three systems 
that were mentioned was substantially increased. A second study not only 
replicated these findings, but showed that sient: who Seaersee pruned: 
Ree judged starting failure: (due to all causes),to be less likely 

than did those who observed the daprined- tree. 


Insert Table 3 about here 
Overconfidence ee 
Kidating with certainty. A pacticdiariy pernicious aspect of 
heuristics is that people typically have great confidence in judgments based 


upon them. In another follow-up to the study on causes of death, people 


were asked to indicate the odds that they were correct in choosing the 
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more frequent of two lethal events (Fischhoff, Slovic & Lichtenstein, 
1977). Table 4 shows the percentages of correct answers‘for each of 

the most frequently used odds categories. In Experiment: 1, subjects 

were reasonably well calibrated when they gave odds of 1:1, 1.5:1, 2:1, 
and 3:1. That is, their percentage of correct answers wascclose to the 
appropriate percentage correct, given tone odds. However, as odds 
increased from 3:1 to 100:1, there was little or no increase in accuracy. 
Only 73% of the answers assigned odds of 100:1 were correct (instead of ‘'! 
99.1%). Accuracy "jumped" to 81% at 1000:1 and to 87% at 10,000:1. “For 
answers assigned odds of 1,000 ,000:1 or greater, accuracy was 90%; the 
appropriate degree of confidence would have been odds of 9:1. The 12% 

of responses that are not listed in Table 3 because they fell between 
_the most common odds categories showed a similar pattern of overconfidence. 
In summary, subjects were frequently wrong at even the highest odds 
levels. Moreover, they gave many extreme odds responses. ‘More than 

half of their judgments were greater than 50:1. Almost one-fourth were 


greater than 100:1. 


A second experiment attempted to improve performance by giving 
subjects more instruction. The experimental session began with a 20-minute 
lecture in which the concepts of probability and odds were carefully ex- 
plained. The subtleties of expressing one's feelings of uncertainty as 
Adrien, a Moade judgments were discussed, with special emphasis on how 
to use small odds (between 1:1 and 2:1) when one is quite uncertain about 
the correct answer. A chart was provided showing the relationship 
between various odds and the corresponding probabilities. Finally, 


subjects were taught the concept of calibration (Chapter ) and were 


in Table 5. This bet is advantageous for perfectly calibrated and 
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urged to make odds judgments in a way that would lead them to be well 
calibrated. Although performance improved somewhat, subjects again 
exhibited unwarranted certainty (see Table 4). They assigned odds 
ree than or equal to 50:1 to approximately one-third of the items. 
Only 83% of the answers associated with these odds were dieest. 

In a third;experiment, people proved to be just as overconfident 
when answering questions of general knowledge (e.g., Which ceueeiee had 
the largest circulation in 1970? (a) Playboy or (b) Time) as when 
they answered questions about the frequency of lethal events (see Table 4). 


Additional studies tested people's faith in théir odds assessments by 


asking if they would stake money on them by playing the bet described 


underconfident participants and disadvantageous to overconfident ones. 
Most participants in our studies were eager to play the game. Because 


their confidence was unjustified, they suffered sizeable monetary losses 


(which we returned to them after the experiment was over). 
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Although the psychological basis for unwarranted certainty is 
complex, a key element seems to be people's lackof searatics that 
their knowledge is based on assumptions that are often quite tenuous. 
For example, 30% of the respondents in Experiment 1 gave odds greater 
than 50:1 to the indortect assertion that homicides are more frequent 
than suicides. These individuals may have beenimisled by the greater 
ease of recalling instances of homicide, failing to appreciate that 
memorability is an imperfect basis for inference. 

Hyperprecision. Overconfidence manifests itself in other ways as’ 


well. A typical task in estimating uncertain quantities such as failure 
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rates is to set upper and lower bounds so that there is a 98% chance 
that the true value lies between them. Experiments with diverse groups 
of people making many different kinds of judgments have shown that, 
rather than 2% of true values falling outside the 98% confidence bounds, 
20-50% do so (Alpert & Raiffa, Chapter ; fiahbensteda: Fischhoff & 
Phillips, Chapter ). Thus people think that they can estimate such 
values with much greater precision than is actually the case. MTversky 
and Kahneman (Chapter 1) have attributed such hyperprecision to reliance 
on the anchoring and. adjustment heuristic. 

Grereouitaene experts. Unfortunately, experts, once they are forced to 
go beyond their data and rely on judgment. may be as prone to 
overconfidence as lay people. Fischhoff, Slovic and Lichtenstein (1978) 
repeated their fault-tree study (Figure 3) with professional automobile 
mechanics (averaging about 15 years of experience) and found these experts 
to be almost as insensitive as lay persons to deletions from the tree 
(see Table 6). Hynes and Vanmiarcke (1976) asked seven "internationally 
known" geotechnical aetnaeds to predict the height of an embankment that 
would cause a clay foundation to fail and to specify confidence bounds 
around this estimate that were wide enough to have a 50% chance of enclos- 
ing the true failure héight. None of the bounds specified by these 
cea eiriars Sia did enclose the true failure height. _ Figure 4. shows 
these results, along with another example of Bunnell @veteont idence: 

The multi-million dollar Reactor Safety Study (U.S. Nuclear Regulatory 
Commission, 1975), in assessing the probability of a core melt ina 
nuclear reactor, used the very procedure for setting confidence bounds 


that was shown in Chapters and to produce a high degree of 


overeonfidence. In fact, the "Lewis Committee” concluded its review 
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of ene Reactor Safety Study by noting that despite the great advances made in that 
study "we are certain that the error bands areuunderstated. We cannot 
say by how much. Reasons for this include an inadequate data base, a 
poor statistical treatment, [and] an iaeeeeueteee propagation of uncer- 
tainties throughout the calculation" (U.S. Nuclear Regulatory Commission, 


1978, p. vi). 


Further anecdotal evidence of overconfidence may be found in many 
other technical risk assessments (Fischhoff, 1977). Some common ways in 
which experts may overlook or misjudge pathways to disaster are shown in 


Table 7. The 1976 collapse of the Teton Dam provides a tragic case in point. 


The Commit tee on Government Operations attributed this disaster to the 
unwarranted confidence of engineers who were absolutely certain they had 
solved the many serious problems that arose during construction (U.S. 
Government, 1976). Failure probabilities are typically not even calcu- 
lated for new dams even though about 1 in 300 fails when the reservoir 
is first filled. 
Informing People About Risks 

Thinking clearly about risk is difficult. Unfortunately, it is also 
necessary. Radiation hazards, medical side effects, occupational diseases, 
food contaminants, toxic chemicals and mechanical malfunctions increasingly 
fill our newspapers and our thoughts. Since the management of these 
‘hazatds’ is, vital to the well-being of individuals and society, people 
are presently asserting nei right to play an active role in the decishon-making 


process. As a result, the promoters and regulators of hazardous enter- 
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prises face growing pressure toiinform people about the risks they face 
(see Figure 5). For example: 

~-The Food and Drug Administration is fiandweane patient information 
inserts for an increased number of prescription drugs. 

--The Department of Housing and Urban Development now requires 
the sellers of :homes built before 1950 to inform buyers about the 
presence of lead-based paints. 

--The proposed federal products liability law places increased 
wéight on adequately informing consumers and workers about risks they 
are likely to-encounter. 

--The Whit e House has directed the Secretary of Health, Education 
and Welfare to develop a public information program on the health effects 


of radiation exposure. 


Despite these good intentions, creating effective informational 
programs may be quite difficult. Doing an adequate job means finding 
cogent ways of presenting complex, technical material that ig often clouded 
by uncertainty. Not only is the allotted time sometimes very limited, 
but messages must confront the listeners’ preconceptions (and perhaps 
misconceptions) about the hazard in question and its consequences. For 
example, in some situations, misleading personal experiences may promote 
a false sense of security, whereas in other circumstances, mere discussion 
of possible adverse consequences may enhance their apparent threat. Moreover, 
as Ross and Anderson (Chapter ) have demonstrated, people's beliefs 
often change slowly and show extraordinary persistence in the face of 
contrary evidence. What follows is a brief overview of some additional 


challenges that information programs must confront. 


Presentation Format is Important 


Subtle changes in the way that risks are expressed can have a major 
impact on perceptions and behavior. For example, the designers of a 
fault tree like that in Figure 3 must make numerous discretionary deci- 
sions regarding how to organize and present the various sources of 
trouble. One such decision which apparently makes little difference is 
how much detail to offer; Fischhoff, Slovic and Lichtenstein (1978) found 
similar perceptions with varying levels of detail. Merely mentioning a 
branch allowed people to estimate accurately how troublesome that branch 
would look when fully detailed. However, fusing branches (e.g., combining 
starting system and ignition system into one broader category) oy 
splitting Biches (e.g., separating ignition system into ignition system--— 
items 1 and 3 in Figure 3 and distribution system--items 2 and 4) did 
make a difference. A given set of problems was judged to account for 
about 30% more failures when it was presented as two branches than when 


it was presented as one. 
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A second demonstration of the importance of presentation format 
comes from a study of attitudes towards the use of automobile seat 
belts (Slovic, Fischhoff & Lichtenstein, 1978). Drawing upon previous 
research demonstrating the critical importance of probability of harm in 
triggering protective action (Slovic, Fischhoff, Lichtenstein, Corrigan 
& Combs, 1978), Slovic et al. argued that people's reluctance to wear 
seat belts voluntarily might be due to the extremely small probability of 
incurring a fatal accident on 2 single automobile trip. Since a fatal 


accident occurs only about once in every 3.5 million person trips and 


a disabling injury only once in every 100,000 person trips, refusing to 
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buckle one's seat belt may seem quite reasonable. It looks less 
reasonable, however, if one adopts a multiple-trip perspective and 
considers the substantial probability of an accident on some trip. 

Over 50 years of driving (about 40,000 trips), the probability of being 


killed rises to .01 and the probability of experiencing at least one 


disabling injury is .33. In 4 pilot study,. Slovic et al. showed that people 


asked. to consider. this lifetime. perspective: responded more favorably towards 
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seat-belts (and air bags) than did people asked to consider a trip-by- 
trip perspective. Whether the favorable attitudes towards seat belts 
induced by a lengthened time perspective would be maintained and 
translated into behavior, remains to be seen. 

One of the most general of presentation artifacts is anchoring, 
the tendency of judgments to be anchored on initially-presented values 
(Poulton, 1968; see also Chapter 1). In another condition of the 
experiment presented in Figure 2, Lichtenstein et al. (1978) asked a = 
second group Se neopie to estimate the frequency of death in the United 
States from each of the 40 different causes. However, instead of being 


told that about 50,000 people die annually in motorvvehicle accidents, 


these individuals were told about the 1,000 annual deaths from electrocution. 
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Although both reports were accurate, provision of a smaller number . 
reduced responderits' estimates of. most frequencies. Such. anchoring on the 
original number led the estimates ‘of ithe two groups to differ by as much as 
a factor of 5 in some cases. 

. Fischhoff and MacGregor (1980) asked people to judge the lethality 
of various potential causes of déath-usingi:ione of four formally equivalent 
formats (e.g., for each afflicted person who. dies, how many survive? 
For each 100,000 people afflicted, how many will die?). Table.8 expresses 
their judgments in a common format and reveals even more dramatic effects 


of question phrasing on expressed risk perceptions. For example, when 
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people estimated the lethality rate for influenza directly (Column 1), 
their mean response was 393 deaths per 100,000 cases. When toldzthat 
80,000,000 people catch influenza in a normal year and asked to estimate 
the number who die (Column 2), respondents' mean response was 4,800, 
representing a death rate of only 6 per 100,000 cases. This Slight change - 


in the question changed the estimated rate by a factor of more than 60. 


Similar discrepancies occurred with other questions and other hazards. i 
Insert Table 8 about here F 
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Another study (Fischhoff, 1980") asked respondents to estimate the 
risks of an unnamed drug (actiially ,. an oral contraceptive) as these 
were described in two package inserts distributed by the manufacturer} 
one designed for doctors and one for patients. Readers of the:patients' 
form thought that the risk of death from blood clots (the major risk 
described) was 5.1 times as large for users as for non-users; readers of 
the doctors' form thought that it was "only" 2.5 times as large. On 
the other hand, readers of the patients' form estimated a much lower 
overall death rate (1 in 40,000 vs. 1 in 2,000 with the doctors' form). 
Thus, in the doctors'-form, the risk seemed greater by one measure and less 
by another, almost identical measure. The reason for this discrepancy 
seems to be that the patient's version gave a number of representative 
death and morbidity rates, revealing that the absolute value of a risk 
that seemed relatively high was an order of magnitude smaller than that 
imagined by readers of the doctors' form. Had only one risk question 
been asked, one would have had a rather different picture of readers' 
knowledge and the effect of the textual differences between the inserts. 

Numerous other format effects have been documented in the literature 
on risk-taking behavior. For example, people have been found to evaluate 
gambles much differently when they consider them in pairs than when they 


. judge them singly (Grether & Plott, 1979; Lichtenstien & Slovic, 1971; 1973). 
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Fischhoff, Slovic and Lichtenstein (1980), Hershey, afid:Schoemaker (1980), 
and Schoemaker and Kunreuther (1979) have noted that decisions about whether 
to buy insurance are frequently reversed when the problem is portrayed - 
as a choice between facing a gamble bi accepting a loss of a smaller 
amount of money. The same risk options, described in terms of lives 
saved, may be evaluated much differently when framed in terms of lives 
lost (Tversky & Kahneman, in press). Additional format and context effects 
can be found in Fischhoff, Slovic and Lichtenstein (1980), Kahneman and 
pee?) oes and Tversky and Kahneman Sa press). 
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The fact that subtle differences in how risks are peueuneea can 


have marked effects on how they are perceived suggests that those respon- 
sible for information programs have considerable ability to manipulate 
“perceptions. Moreover, since these effects are not widely known, people 
may inadvertently be manipulating their own perceptions by casual deci- 


sions they make about how to organize their knowledge. 


Cross~Hazard Comparisons May Be Misleading 


One of the most common approaches for deepening people's perspec- 


tives is to present quantified risk estimates for a variety of hazards. 
| Presumably, the sophistication gleaned from examining such data will ‘a 
useful for personal and societal decision making. Wilson (1979) observed 
that we should "try to measure our risks quantitatively ... . Then 
we could compare risks and decide which to accept or reject" (p. 43). 
Lord Rothschild (1979) added, "There is no point in getting into a panic 
about the risks of life until you have compared the risks which worry 
you with those that don't, but perhaps should." 
Typically, such exhortations are followed by elaborate tables and 


even "catalogs of risks" in which diverse indices of death or disability 


are displayed for a broad spectrum of life's hazards. Thus, Sowby (1965) 
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provided extensive data on risks per hour of exposure, showing, for example, 
that an hour riding a motorcycle is as risky as an hour of being 75 
years old. Wilson (1979) developed Table 9, which displays a set of 
activities, each of which is estimated to increase one's chances of 
death (during the next year) by 1 in one million. Wilson claimed that 
" . . these comparisons help me evaluate risks and I imagine that they 
may help others to do so, as well. But the most iaportant use of these 
comparisons must be to help the decisions we make, as a nation, to 
improve our health and reduce our accident rate" (p. 45). Similarly, Cohen 
and Lee (1979) | ranked many hazards in terms of their expected reduction 
in life expectancy on the assumption that "to some approximation, the 
ordering (in thie table) should be society's order of:priorities. However, 
we see several very major problems that have received very little ae 


tion . . . whereas some of the items near the bottom of the list, espec- 


ially those involving radiation, receive a great deal of attention" 


Properly speaking, comparing hazards is not a decision-making pro- 


cedure. It does not require any particular conclusion to be drawn, 


say, from the contrast between the risks of motorcycling and advanced 

age (Fischhoff, Slovic, Lichtenstein, Derby & Keeney, 1980). Moreover, 
even as aids to entuicdon, cross—-hazards comparisons have a number of 
inherent Limitations. For example, although some esepie feel enlightened 
upon learning that a single takeoff or landing in a commercial airliner 
reduces pnene life expectancy , by an average of 15 minutes, others find 
themselves completely bewildered by such information. On eating, one 
will either die prematurely (almost certaintly by more than 15 minutés) 


we 
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or one @tt- sot: For many people, averages do not adequately capture 

the essence of such risks. Indeed, McNeil, Weichselbaum and Pauker 
(1978) found that patients eee the prospect of surgery for lung cancer 
were as concerned with the possibility of imminent seach during the oper- 


ation as with its contribution to their life expectancy. 


pent pment A ete BL pe 


A further limitation is that summary statistics may mask important 
characteristics of risk. Where there is uncertainty or disagreement 
about the facts, presentation of point estimates may inspire undue 
confidence. Since people are particularly concerned about the potential 
for catastrophic accidents (Slovic, Fischhoff & Lichtenstein, 1980),- 
some indication of the probability and magnitude of extreme losses is 
meeded. Other characteristics that affect people's attitude toward 
hazards, but are Aepieweed in statistical summaries, are voluntariness, 
controllability, familiarity, immediacy of consequences, threat to 
future generations, the ease of reducing the risk and the degree to 


which benefits are distributed equitably to those who bear the risk 


ee ar nce 


(Slovic, Fischhoff & Lichtenstein, 1980. Although some faults, such | 


as the omission of uncertainty bands, are easy to correct, determining 
how to weight catastrophic potential, equity and other important 


characteristics, will require a serious research effort. 
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Conclusions 

informing people, whether by warning labels, package inserts, or 
‘extensive media programs, is but part of the larger. problem of helping people 
cope with the risks and uncertainties of modern life. We believe that 
some of the responsibility lies with our schools. Public school curricula 
should include material designed to teach people that the world in which 
they live is probabilistic, not deterministic, and to help them learn 
judgment and decteion steateries for dealing with that world (Marém & Dekel, 
1980). These strategies are as necessary for navigating in a world of 
uncertain information as geometry and erigonometty- are to navigating among 
physical objects. 

NUCLEAR POWER: A CASE STUDY OF RISK PERCEPTION 

Nowhere are issues of perceived oy axe salient or the stakes 
higher than in the controversy over eeerece power. This section examines 
the controversy in light of the findings discussed above. 
The General Problem 

Even before the accident at Three Mile Island, the nuclear industry 
was foundering on the shoals of adverse public opinion. A sizeable 


and tenacious opposition movement had been responsible for costly delays 


in the licensing and construction of new power plants in the United 
States and for political turmoil in several European nations. 

The errant reactor at Three Mile Island stimulated a predictable 
immediate rise in anti-nuclear fervor. iy attempt to plan the role of 
nuclear power in the nation's energy future must consider the determinants 
of this opposition and anticipate its future course. One clue lies in 


recent research showing that the images of potential nuclear disasters 


that have been formed in the minds of the anti-nuclear public 
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are remarkably different from the sicedenbaes put forth by many technical 
experts. We shall describe these images and speculate on their origins, 
permanence, and implications. 
Basic Perceptions 

Questionnaire studies of people opposed to nuclear power show. that 
they iudee™ its benefits as quite low and its risks as manceseeuns great 
(Fischhofé, Slovic, Lichtenstein, Read & Combs, 1978). On the benefit Side, 
‘these ‘individuals do not. see nuclear power as a vital link in meeting basic 
energy needs (Pokorny, 1977); rather many view it as a supplement to other 
sources of energy which are themselves adequate (or could be made adequate 
by conservation). On the risk side, nuclear power evokes greater feelings 
of dréad than‘almost any other technological activity (Fischhoff et ali, 
1978). Some have attributed this reaction to fear of Sedison’s invisi- 
ble and irreversible contamination, threatening cancer and genetic damage. 
However, usevek diagnostic X rays, a radiation technology whichiincurs.. 
similar risks, is not similarly dreaded. To the contrary, its risks are 
often underestimated (Slovie et al., 1979a). The association of nuclear 
power with nuclear weaponry may account for these different perceptions. 
As Z result of its violent origins, nuclear power is regarded as a tech- 
nology whose risks are uncontrollable, lethal, and potentially catas- 
trophic, characteristics that are not associated with the use of diagnos- 
tic X rays. 


When people opposed to nuclear power describe their mental images of 


a nuclear accident and its consequences, they reveal the expectation that 


a serious reactor accident is likely within their lifetime and could result in 


hundreds of thousands, even millions, of deaths (Slovic, Fischhoff & Lichtenstein, 


1979a, b). Such an accident is also expected to cause irreparable 
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environmental damage over:a vast geographic area. These expectations con- 
trast dramatically with the nuclear industry's view that multiple safety 
systems will limit the damage in the extremely unlikely event of a major 
accident. 

One inevitable consequence of this "perception gap" is uncertainty 
and distrust on the part of a public suspecting that the risks are much 
greater than the experts’ assessments (Kasper, 1979; Starr & Whipple, 
1980). The experts, in turn, question the rationality of the public and 
decry the "emotionalism" stymying technological progress. Bitter and 
sometimes violent confrontations result. | 

Recognition of this perception gap has led some technical experts 
to claim that the public must be "educated" about the "real" risks from 
nuclear power. One. public opinion analyst (Pokorny, 1977) put the matter 
as follows: 

The biggest problem hindering a sophisticated judgment on 
this question is basic lack of knowledge and facts. Within 
_this current attitudinal milieu, scare stories, confusion, and 
irrationality often triumph. Only through careful education of 
facts and knowledge can the people know what the real choices 


are... (p. 12). 


ren ae 


ees ee 


ne LR AN . 
Our own view is that attempts designed to reduce the perception gap 


face major obstacles. This conclusion. is. based on,two key aspects of 
the problen, one technical and one psychological. 


Technical Obstacles 


The technical reality is that there are few "cut-and-dried facts" 
regarding the probabilities of serious reactor mishaps. The technology 
is so new and the probabilities in question are so small that accurate 


risk estimates cannot be based on empirical observation. Instead, such 
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assessments must be derived from complex mathematical models and sub- 
jective judgments. 

The difficulty of performing risk assessments has led many critics 
to question their validity (Bryan, 1974; Fischhoff, 1977; Primack, 1975). 
One major coneecn is that important initiating events or pathways to 
failure may be omitted, causing risks to be underestimated (see Table 7). 


Another problem in assessing the reliability of reactor designs is the 


difficulty of taking proper account of eononemods failures,” in which 
ostensibly independent systems designed to ee up one another fail 
due to the same unanticipated common cause . Nuclear critic, John Holdren's 
skepticism regarding the defensibility of sageesments of rare catastrophies 
summarizes the technical problem concisely: 

| » . . the expert community is divided about the conceivable 

realism of probability estimates in the range of one in ten 

thousand to one in one billion per reactor year. I am among 

those who believe it to be impossible te principle to support 

numbers as small as these with convincing theoretical arguments .... . 

‘The reason I hold this view is straightforward: nuclear=power 

systems are so complex that the probability the safety analysis 

contains serious errors . . . is so big as to render meaningless 

the tiny computed probability of accident (Holdren, 1976, p. 21). 
Psychological, Obstacles 

Public fears of nuclear power should not be viewed as irrational. 
In part, they are fed by the realization that the facts are in dispute 


and that experts have been wrong inthe past, as when they irradiated 


enlarged tonsils or permitted people to witness A-bomb tests at close 


range. What one may question is the extent to which people's fundamental 
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ways of thinitine <(edch-a8 reliance on the availability heuristic) lead 
them to distorted views. Certainly the risks Pree nuclear power would 
seem to be a prime candidate-for availability bias because of the 
extensive iaars coverage they receive and their association with the 
vivid, imaginable dangers of nuclear war. 

As mentioned earlier, the availability heuristic implies that Bae 
discussion of nuclear accidents may increase their imaginability and 
hence their perceived risk. Consider an engineer ene the safety of 
dieposine of nuclear wastes in a salt bed by pointing out the improbability 
of the various ways radioactivity could be accidentally released (see 
Figure 1). Rather than reassuring the audience, the Svoeentstion might 


lead them to think, "I didn't realize there were that many things that 


could go wrong." In this way, reliance on memorability and imaginability 
may blur the distinction between what is remotely possible and what is 
probable. As one nuclear proponent lamented, "When laymen discuss what 
might happen, they sometimes don't even bother to: include the ‘might'" 
(B. Cohen, 1974, p. 36). Another analyst has elaborated a similar theme 
in the misinterpretation of "worst case" scenarios: 


| It often has made little difference how bizarre or improbable 


the assumption in such an analysis was, since one had only to 


show that some undesirable effect could occur at a probability 
level greater than zero. Opponents of a proposed operation could 
destroy it simply by exercising their imaginations to dream. up a 
set of conditions ee although they might admittedly be ex- 
tremely improbable, could lead to some undesirable results. With 
such attitudes prevalent, planning a given nuclear operation 
becomes . . . perilous... . (J. Cohen, 1972, p. 55). 
Conclusion. 


Although the above discussion designated some possible sources of 


the perception gap between pro-nuclear and anti-nuclear individuals, it 
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does not point unambiguously to one side or the other as having the most 
accurate appraisal of the overall risks from nutlear power. The effects 
of memorability and imaginability are capable both of enhancing public 
fears and obscuring experts’ awareness of ways that a syurcin could fail. 
Insofar as the actual risks may never be known with great precision and 
new information tends to be interpreted in a manner consistent with one's 
prior beliefs, the perception gap may be with us for a long time. Thus, 
- for some people, Three Mile Island “proved” the possibility of a 


catastrophic meltdown, whereas for others, it confirmed their faith in 


the reliability of the multiple safety and containment systems. 


"WHO. SHALL DECIDE? =. 

: The research: described in this chapter demonstrates that judgment of risk 
is fallible. It also shows that the. degree of fallibility is. often. sur- 
prisingly great and that faulty estimates may be held with great confidence. 
Since even well-informed lay people have difficulty judging risks accur- 
ately, it is tempting to conclude that the public should be removed from 
society's risk assessment and decision-making processes. Such action 
would seem to be misguided on several counts. First, close examination 
shows that people do perceive some things quite well, although their 
perspective may often be quite different from that of technical experts. 
In situations ineee misunderstanding is rampant, people's errors can often 
be traced to biased experiences, which education may be able«to counter. 
In some cases, people's strong fears and resistance to experts’ reassur- 
ances can be raced £6 their sensitivity to the potential for catas- 
trophic accidents, to their awareness of expert disagreement about the 
probabilities and aieedtuade of such accidents, and to their knowledge of 


serious mistakes made by experts in the past. Even in difficult cases, 
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such as the conflict over nuclear power, an atmosphere of trust and a 
recognition that both experts and: lay persons have something to 
contribute, may permit some exchange of information aid deepening of per- 
spectives. | 

Moreover, in many if not most cases, effective hazard-:management 
requires the cooperation of a large body of lay people. These people 
must agree to do without some things and accept substitutes for others; 
they.:must vote sensibly on ballot measures and for legislators who will 
serve them as surrogate hazard managers; they must obey safety rules and 
use the legal system responsibly. Even if the experts were much better 
judges of risk than lay people, giving experts an exclusive franchise 
for hazard management would mean substituting short-term efficiency for 
the long-term effort needed to create an informed citizenry. 

For non-experts, the.ifindings,-discussed above pose an important 
series of challenges: to be better informed, to rely less on unexamined 
or unsupported judgments, to be aware of the factors that might bias risk 
judgments, and to be more open to new evidence; in short, to realize the 
potential of being educable. 

For experts and policy makers, these findings pose what may be a more 
difficult challenge: to recognize and admit one's own cognitive limita- 
tions, to attempt to educate without propagandizing, to acknowledge the 
legitimacy of public concerns, and somehow to develop ways in which these 
congerns can find expression in societal decisions without, in the process, 


creating more heat than light. 
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Table i 


Bias in Judged Frequency of Death 


Most © 


Most a 
Underestimated 


Overestimated . 


All accidents Smallpox vaccination 


Motor vehicle accidents - Diabetes 


Pregnancy, childbirth, 
and abortion 


Stomach cancer 


rs Lightning 
Tornadoes 
Stroke 
Flood 
Tuberculosis 
Botulism ie : 
; ~) Asthma 
All cancer 
Emphysema 


Fire and flames 


Venomous bite or sting 


“ 


Homicide 


Source: Slovic, Fischhoff & Lichtenstein (1979/a). 


Statistical Fréquency and Newspaper Coverage 
in the Eugene, Oregon Register Guard (R-G) and the 


New Bedford, Massachusetts Standard Times (S-T) 


- Cause of Death 


Smallpox 

Poisoning by vitamins 
Botulism 

Measles 

Fireworks. 

Smallpox Vaccination 
Whooping cough 
Polio 

Venomous bit or sting 
10. Tornado 

ll. Lightning 

12. Non-venomous animal 
13. . Flood 

14. Excess cold 

15. . Syphilis 

16. Pregnancy, birth & abort. 
17. Infectious hepatitis 
18. Appendicitis 

19. Electrocution 

20. MV/train collision 
21. Asthma 

22. Firearm accident 

23. Poison by solid/liquid 
24. Tuberculosis 

25. Fire'and flames 

26. Drowning 

27. Leukemia 

28. Accidental falls 

29. Homicide 

' 30. Emphysema 

31. Suicide 

32. Breast cancer 

33. Diabetes 

34. Motor vehicle accident 
35. Lung cancer © 

36. Stomach cancer 

37. All accidents 

38. Stroke 

39. All cancer 

40. Heart disease 

41. All disease . 
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Correlations (R-G vs. S-T) 


Rate per g Subjects’ 


2.05 x 10 
U.S. Res. Estimates 
0 57 
vi 102 
2 183 
5 168 
6 160 
8 23 
15 93 
17 97 
48 350 
99 564 
107 91 
129 174 
205 736 
334 314 
410 492 
451 1,344 
677 545. 
902 605 
1,025, 766 
1,517 689 
1,886 ~~. 506 
2,255 .1,345 
2,563 1,013 
3,690 658 
7,380 : 3,336 
7,380 1,684_ 
°14,555 2,496 
17,425 2,675 
18,860 5,582 
21,730 2,848 
24,600 . 4,679 
31,160 2,964 
38,950 1,476 
55,350 41,161 
- 75,850 9,764 
95,120 3,283 
112,750 * 88,879 
209,100 7,109 
328,000 45,609 
738,000 23,599 
1,740,450 - 88,838 


Table 2 


for 41 Causes of Death 


Source: Combs & Slovic (1979). 
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Table 3 


Attribution of Starting Failures for Pruned and Unpruned Trees 


Mean proportion of starting failures attributed to: 


;i 7 Cr en EER 


Starting Fuel Ignition . Mis- 
Group n Battery System System System Engine Chief Other 


Unpruned tree 93 - 264 195 303. & 2164 076 051 .078 
Pruned tree l 29. 04320 -=-— a ch 1402 
Pruned tree 2. 26 Sue W357 sone. -4 313 eater. 024 227° 


é - - eS . 
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Note: A dash indicates that the branch was deleted. 
ashould be .468 


should be .611 


Source: Fischhoff, Slovic and Lichtenstein (1978). 


Table 4 


Percentage of Correct Answers for Major Odds Categories 


: General-knowledge 
Lethal events questions 


Experiment 1 Experiment 2 Experiment 3 
- Appropriate © -_—_— oe 
% : % cor- . % cor- % cor- 
Odds correct* N &%N_ rect ~ N BN — rect N GN rect 
I:f 50 644 9 53 339 & 54 861 19 $3 
1S:1 60 68 1 5? 108 = 2.5 39 21005 56 
2:1 67 $75, 8 64 434 10 65 455 1 63 
3:1 75 : 189 2 71 2526 65 157 3.5 76 
$31 83 250 4 70 _ 322 8 71 194 4 76 
10:1 91 1,167 {7 66—C« 390 9 76 ‘376 8 74 
20:1 95 126 2 72 1634 $1 66 1.5 83 
30:1 98 258 4 68 227) § 74 69 1.5 - 83 
100:1 99 1,180 17 73 319° 8 87 376 8 80 
1,000:1 99.9 862 = 13 81 219) 5 84 334 7 88 
10,000: 1 100 459 7 87 138 3 92 263 6 &9 
100,000:1 100 163 2 85 23 5 96 134 3 92. 
1,000 ,000:1 100 187 2 90 47 1. 96 3608 94 
Total 6,098 388 | 2,981 70 3,855 75 
Overall % correct 71.0 72.5 : 73.1 


Note: % N refers to the percentage of odds judgments that fell in 
each of the major categories. There were 66 subjects in Experiment 1, 
40 in Experiment 2, and 42 in Experiment 3. 


*For well-calibrated subjects 

. 
Experiments: 1, 2 and 3 were labeled Experiments 2, 3 and 4 in the original 

report. 


Source: Fischhoff, Slovic and Lichtenstein (1977). 


Table 5 


¢ 


Instructions for "Trivia Question Hustling" 


The experiment is over. You have just earned.$2.50, which you will 
be able to collect soon. But before you take the money and leave, I'd 
like you to consider whether you would be willing to play a certain game 
in order to possibly increase your earnings. The rules of the game are 
as follows: 


1. Look at your answer sheet. Find the questions where you estimated 
the odds of your being correct as 50:1 or greater than 50:1. How many 
such questions were there? ‘(write number). 


2. I'll give you the correct answers to these "50:1 or greater" questions. 
We'll count how many times your answers to these questions were wrong. 
Since a wrong answer in:the. face of such high certainty would be surprising, 
we'll call these wrong answers "your surprises." 


3. I have a bag of poker chips in front of*me. |There are 100 white 
chips and 2 red chips in the bag. If I reach injand randomly select a 
chip, the odds that I will select a white chip are 100:2 or 50:1, just 
like the odds that your "50:1" answers are correct. 

| 
4. For every "50:1 or greater" answer you gave, I'll draw a chip out 
of the bag. (If you wish, you can draw the chips for me.) I'11 put the 
chip back in the bag before I draw again, so the odds won't change. The 
probability of my drawing a red chip is 1/51. Since drawing a red chip 
iscunlikely, every red chip I draw can be considered "my surprise." 


5. Every time you are surprised byza wrong answer to a "50:1 or greater" 
question, you pay me $1 (raised to $2.50 in someiconditions). Every 
time I am surprised by drawing a red chip,=I'll pay you $1. 


6. If you are well calibrated, this game is advantageous to you. This 
is because I expect to lose $1 about once out of /every 51 times I draw 
a chip, on the average. But since your odds are|sometimes higher than 
50:1, you expect to lose less often than that. \ 


7. Would you play this game? 


i 


Source: Fischhoff, Slovic & Lichtenstein (1977). 


Table 6 


Experts’ Insensitivity to Omissions from the 


Car-Won't-Start Fault Tree 
I 


Mean proportion of starting failures attributed to 


Start- Igni- 
ing Fuel tion | Mis- 


Group n Battery System System System Engine chief Other 


- Unpruned tree 


ordinary subjects 93 - 264 -195 .193 . .144 -076 .051 #.078 
Unpruned tree “vats 

experts 13 «410 .108 096 . 248 -O51 .025 .060 
Pruned tree 1 : 

experts 16 483 “+--+ (229. “ce OTS; Ses. 00s? 


ashould be .441 


Source: Fischhoff, Slovic and Lichtenstein (1978). 
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Table 7 


Pathways to Overconfidence in Experts’ Risk Assessments 


_* Failure to consider the ways in which human errors can affect 
technological systems. Example: Due to inadequate training and 
control room design, operators at Three Mile Island repeatedly mis- 
diagnosed the problems of the reactor and took inappropriate actions 
(Sheridan, 1980; U.S. Government, ‘1979). 


* Overconfidence in current scientific rout caee: Example: Use © 
of DDT came into widespread and uncontrolled use before scientists had 
even considered the possibility of the side effects that today make it 
look like a mixed and irreversible blessing (Dunlap, 1978). 


* Failure to appreciate how technological systems function as a 
whole.. Example: - The DC-10 failed in several early flights because 
its designers had not realized that decompression of the cargo compart- 
ment would destroy vital control systems (Hohenemser, 1975). 


* Slowness in detecting chronic, cumulative effects. Example: 
‘Although accidents to coal miners have long been recognized as one 
cost of operating fossil-fueled plants, the effects of acid rains on 
ecosystems were slow to be discovered. 


*vadaure to anticipate human response.:‘to safety measures. Ex- 
ample: The partial protection afforded by dams. and levees gives people: 
a false sense of security and promotes development of the flood plain. 
Thus, although floods are rarer, damage per flood is so much greater 
that the average yearly dollar loss is larger than before the dams 


were built «Burton, - Kates. & White, 1978). 


* Failure to anticipate ' ‘common-mode failures" which simul- . 
taneously afflict systems that are designed to be independent. 
Example: Because electrical cables controlling the multiple safety 
systems of the reactor at Browns Ferry, Alabama, were not spatially 
separated, all five emergency core cooling systems were damaged . 
by a single fire (U.S. Government, 1975; Jennergren Keenéy"in press), 
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Lethality Judgments with Different Response Modes 
Geometric Means 


‘Death Rate per 100,000 Afflicted 


Estimate Estimate Estimate Estimate Actual 
Lethality Number | Survival Number . Lethality _ 
Malady - Rate Died Rate — Survived Rate’ ; 
| Influenza 393002 2% - Sil: . 1, 
ee «Ag 114 ae 4 12 
asthma | 155... 2 14 599 33 
Venereal Disease | on © 68 0 BD 4190: 
High Blood Pressure — 535 89 = : 17 . 538 «76 
Bronchitis - 162 19 = 43 2,111 85 
Pregnancy 7 | : 67 | . 24 | 13 . 787 | 250 
Diabetes My ox. dau * 52 5,666 800 
Tuberculosis -=—S—«S2_—=<“Cté«~i TB sCBBTSCCB 520 1,535 
Automobile Accidents 6,195 3,272. “31. 6,813. «2,500 
Strokes | 11,011 4,648 = BL. 24,758 11,765 
Heart Attacks 13,011 7 3,666 431 «27,477 16,250 
Cancer 10,889 10,475 160 21,749 37, 500 


Note: The four experimental groups were given the following instructions: 

(a) Estimate lethality rate: for each 100,000 people afflicted, how many die? 
(b) Estimate number died: X people were afflicted, how many died? 

(c) Estimate survival rate: ner each person who ‘died, how many were 
‘afflicted but survived? 

(d) . Estimate number survived: Y Recpae died, how y many were afflicted. 

but did not die? 

Responses to questions (b), (ce), ead (d) were converted to deaths per 

100,000 to facilitate comparisons. Source: Fischhoff &.MacGregor, 1980. 


+ 
at’ 


ft 


Table 9” 
i 


Risks Which Increase Chance SE Death 


in Any Year by 0.000001... 


Smoking 1.4 cigereties 
Drinking 1/2 liter of wine 
Spending 1 hour ina 
coal mine 


Spending 3 hours ina 
coal mine 


Living 2 cays in New York or 
Sosion 

Travelling 6 rinutes by canoe 
Travelling 10 miles by bicycle 
Travelling 309 miles oy car 
Flying 1000 miles by jet 
Flying 6000 miles by jet 


Living 2 months in Denver 

_ onvecation trom N.Y. 
Living 2 months in average 
stone or brick building 

One chest x-ray taken in 
@good hospital 

Living 2 months with & 
cigaretie smoker 

Eating 40 teblespoons of 
peanut butier : 
Drinking Miemi drinking - 
water for 1 year : 
Drinking 30 12 oz. cans of 
Giet soca 

Living 5 years at site 
boundary of 2 typical nuclear 
power plant inthe open 
Drinking 1000 24 oz. , 

so% drinks from recently 
bannec plestic bottles 
Living 20 years near 

PVC plant 

Living 150 years within 20 
miles of a nuclear power plant 
Ezting 100 charcoal broiled 
steaks . 
Risk of accident by living 
within 5 miles of a 

nuclear reactor for 50 years 


°(1 paten T milion) 


from Wilson, 1979. 


Cancer, heen diseese 
Cirrhosis ofthe liver — 


Bleck lung disease 
Accicent - 


Air pollution 

Acsiden 

Accident 
Accident 

Accioent 


Cancer caused by cosmic 
radiation 


Cancer causes by cosmic 
radiation 


Cancer caused by natural 
radioactivity 


Cancer causec by radiation 


Cancer, heart disease 


Liver cancer caused by 
afiatoxin 8 


Cancer caused dy 
chloroform 


Cencer ceusec by 
saccharin Ns 


Cancer caused by radiation 


Cencer from acrylonitrile 
monomer 


Cencer caused by vinyl 
chloride (1E7€ stancard) 


Cancer caused by raciation 


Cancer from benzopyrene 


Cancer caused by radiation 


Figure Captions 

1. A fault tree indicating the various ways in which radioactive 
material might accidentally be released from nuclear wastes buried 
within a salt deposit. To read this tree, en with the bottom row 
of possible initiating events, each of which can lead to the trans- 
portation of radioactivity by groundwater. This transport can in 
turn release radioactivity to the biosphere. As indicated by the 
second level of boxes, release of radioactivity can also be produced 
directly (without the help of groundwater) through the impact of a 
large meteorite, a nuclear weapon, or a volcanic eruption. Source: 
McGrath (1974). 

.2. Relationship between judged frequency and the actual number of 
deaths per year for 41 causes of death. If judged and actual 
frequencies were equal, the data would fall on the straight line. The 
points, and the curved line fitted to them, represent the averaged 
responses of a large number of lay people. As an index of the 
variability across individuals, vertical bars are drawn to depict the 
25th and 75th percentiles of the judgments for botulism, diabetes and 
all accidents. The range of responses for the other 37 causes of 
death was similar. Source: Slovic, Fischhoff & Lichtenstein (1979a). 

3. Fault tree indicating the ways in which a car might fail to 
start. It was used by the authors to study reer people are sensitive 
to the completeness of this type of presentation. Omission of large 
sections of the diagram was found to have little influence on the 
judged degree of completeness. In effect, what was out of sight was 
out of mind. Professional automobile mechanics did not do appreciably 


better on the test than did lay people. Source: Fischhoff, Slovic & 


Lichtenstein (1978). 


4. Two examples of overconfidence in expert judgment. Overconfidence 
is vepteseuted by the faulure of error bars to contain the true value: 
(a) estimates of the rest mass of the sigeeeon (Taylor, 1974); 

(b) estimates of the height at which an embankment would fail (Hynes 


& Vanmarcke, 1976). Our. thanks to Max Henrion for Figure a. 


5. Drawing by S. Harris; (¢)1979. The New Yorker. Magazine, Inc. 
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Note.—Source: McGrath (1974). 
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Slovic, Fischhoff & Lichtenstein (1979a) 


Figure 2 


CAR WON'T START 


FS ASN NE YORI cree aero er 


BATTERY CHARGE STARTING SYSTEM FUEL SYSTEM IGNITION SYSTEM THER ENGINE MISCHIEVOUS ACTS ALL OTHER 
INSUFFICIENT DEFECTIVE DEFECTIVE DEFECTIVE . PROBLEMS OR VANDALISM PROBLEMS 


- Coil faulty 
. Distributor faulty 


: . Switches defective « Insufficient fuel 
. Faulty ground connections . Transmission notin park , Excess fuel (Booding) 
, Terminals loose or corroded of neutral : » Defective choke 
. Battery weak . Seat belt problem |. Defective air filter 
(1974 cars) 
. Faulty starter motor 
. Starter drive defective 


1. Oil too thick . 1, Theft or breskage of vita! 
2. Pistons feoren (e.g. battery) 


. Spark plugs defective 
. Defective wiring between 
components 


3. Poor compression 2. Siphoning of gas 
3, Disruption of wiring 


. Car out of as 


1. Wrong type , 
2. Weather too cold 


« Paint . Clogged fuel line 1. Cap cracked 

. Corrosion . Ignition switeh 3 . Leaks in fuel line 2. Electrodes corroded 

. Dirt A . Starter relay . Dirt ia fuel tank 3. Improper point gap. 

, Loose connections , Neutral start ewitch » Fuel line frozen 4, High point resistance ~ 
. Solenoid . Improperly seated valves 5. Faulty condenser 


. Shaft froven 
~ Timing off 
. Motor not keyed properly 


ajeaseneaaeadghaniatinieltiogecc 


1 , Defective (uel pump 
J 8. Cracked carburetor bow! 
9. Intake manifold gasket 


EST) 


loose 1. Broken ring 
i 2. Excess beat 
1. Lighta left on, motor off 3. Ring groove damaged, 
2. Are : fouled, or loose % 
3. Cold weather « Belts not fasiened . 
4. Defective generator . Driver's belt switch 2 
$. Loose or broken Sanbelt defective . Fuel pump pressure too high . Gap incorrect of fouled 
6, Electrolyte fluid low or i" Heavy object on front seat . Leaking inlet valve . Flug shorting 
improper with belt unfastened . Float out of adjustment or delective wirin i 
7. Cable wires broken 4. Belt fastened before driver . Excess pumping of . Plugs fring in wrong order j 
B. Alternator defective sits down ; accelerator & 
9. Voltage regulator defective . Excess fuel pressure on i. Leaking head gasket 
10. Internal short cireyit hot day 2. Cracked cylinder head 
ti. Too many eleciric . Electric fuel pump Goods 2. Valve burnt, improperly 


ponpany 
wn 


4 


accestories operating 

. Electric leakage 

. Continuous small drain 
(package on front seat of 
1974 models} 

. Battery too amall 


carburetor (foreign cars) 


adjusted, or sticking 
4. Piston, piston rings, or 
: cylinder worn or broken 
* $. Gas washdown on cylinders 


. Choke valve open 
. Valve linkage sticks 


. Failure to choke 
Electric choke misfunction 
(Volkswagen) 


Figure 3 


Source: Fischhoff, Slovic & Lichtenstein (1978) 
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Figure 4. Two examples of overconfidence in expert judgment. 


Overconfidence is represented by the failure of error bars to contain 
the true value: (a) estimates of the rest mass of the electron (Taylor, 
1974); (b) estimates of the height at which an embankment would fail 


» (Hynes & Vanmarcke, 1976). 


Our thanks to Max Henrion for Figure a. 
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Figure 5 


Drawing by S. Harris; ©1979 


The New Yorker Magazine, Inc. 


